zhurnaly 18th December 2022 at 8:09pm
Models represent reality, but simplified to highlight key concepts. How to verify and validate?
Begin with Subject Matter Experts (SMEs), people who know something about the issue. SME judgments can define the Domain within which the model is reliable, and can suggest good Test Challenge Questions to ask the model. Combined with past collections of Ground Truth Data, those tests begin the Model Validation process.
And there's more: model results can and should be further evaluated with New Data and in simulation exercises with human players. That's how to develop Credibility and an appropriate amount of Trust in the model results!
(sketch thanks to LOOPY, an ultralight tool for systems thinking ©2021 MITRE Corporation ...) - ^z - 2021-09-24